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1 Block  diagram  of  an  adaptive  noise  canceler  (ANC).  The  update  equation  for  the  Filter 
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I.  INTRODUCTION 


The  performance  of  the  adaptive  noise  canceller  (ANC),  pictured  in  figure  1 , has 
been  examined  extensively  within  the  framework  of  Wiener  filter  theory  (LI],  [2],  (3]). 
More  recently,  Glover  [4]  has  shown  that  for  the  case  of  a single  sinusoid  and  no  noise  in 
the  reference,  the  output,  e(k),  and  primary  input,  d(k),  are  related  by  a notched-filter 
transfer  function,  a solution  which  falls  outside  the  scope  of  the  classical  theory. 


Figure  1 . Block  diagram  of  an  adaptive  noise  canceler  (ANC).  The  update  equation 
for  the  filter  weights  is  w(k  + 1)  = w(k)  + 2/te(k)  x(k). 

We  examine  here  a more  general  situation  in  which  the  reference  signal  consists  of 
a sinusoid  (possibly  with  random  phase)  in  white  noise.  In  that  case  the  output  power 
spectrum  no  longer  bears  a time  invariant  relation  to  the  spectrum  of  the  primary.  It  is 
the  purpose  of  this  paper  to  derive  an  expression  for  the  output  spectrum.  We  obtain  an 
approximate  analytic  solution  which  incorporates  second  order  statistical  effects  (realized 
as  terms  of  magnitude  /a,  the  feedback  parameter).  This  result  is  then  compared  with  experi- 
mental data  and  a computer  simulation,  which  prove  to  be  in  close  agreement  with  the 
theory. 

It  is  found  that  when  the  primary  input  is  independent  of  the  reference  signal,  a 
notch  will  develop  in  the  output  spectrum  even  though  the  Wiener  solution  for  the  weight 
vector  (the  expected  value  of  w;  cf  [ 1 ] ) is  zero.  On  the  other  hand,  in  the  appropriate 
context  (correlated  reference  and  primary),  our  solution  reduces  to  that  of  Wiener  theory. 

In  general,  although  the  notch  depth  diminishes  with  decreasing  reference  signal-to-noise 
ratio,  the  exact  functional  relationship  depends  on  the  nature  of  the  primary  input. 


II.  THEORY 


Let  the  reference  input  x and  adaptive  filter  w be  L-dimensional  vectors.  We  assume 
that  L < 2.  The  filter  is  updated  using  the  Widrow  LMS  algorithm  [2] , 


w(k  + 1 ) = w(k)  + 2^e(k)  x(k)  , 


0) 


i 


where,  from  figure  1, 

e(k)  = d(k)  - y(k) 


y(k)  = w • x = ^ wg(k)  xg(k) 


with  subscripts  indicating  vector  components. 

The  substitution  of  (2)  into  (1 ) yields 

w(k  + 1 ) = A(k)  w(k)  + 2pp(k)  , 
where  A(k)  is  the  matrix 

Agr(k)  = 8gr  - 2pxg(k)  xr(k) 

and  p(k)  the  vector 

Pg(k)  = Xg(k)  d(k)  . 

The  solution  to  the  linear  difference  equation  (4)  is  given  by 


w(k)  = B(k,0)  w(0)  + 


K-l 

2(j  B(k,m)  p(m)  , 


where 


B(k,m)  = 


A(k  -1 ) A(k  -2) . . . A(m  + 1 ) , m<k-2 


m > k - 1 


k-l 

= 7"[  A(t)  . (7) 

t=m+l 

The  term  B(k,0)  w(0)  is  a transient.  If  the  system  is  stable  (as  in  the  case  for  small  \i\  cf, 
equation  (B-10)  and  151 , [6] ),  lim  ||B(k)||  = 0,  and  for  large  k the  transient  is  negligible. 

k-H» 

Alternately,  we  may  assume  w(0)  = 0.  In  either  case,  it  follows  from  (2)  and  (6)  that 


e(k)  = d(k)-2p  ^ x^(k)  B(k,m)  x(m)  d(m) 
m=0 


= d(k)  - 2/i  ^ ^ f(k,m)  d(m)  , 
m=0 


where  x^  indicates  the  transpose  of  the  vector  x,  and 

/ k_1  \ 

f(k,m)  = xT(k)  I A(t)  1 x(m)  . 

\t=m+l  / 

DESCRIPTION  OF  INPUTS 

We  assume  that  the  reference  input  vector  has  the  form 
xg(k)  = C cos  (coD(k  - 2)  + 0)  + ng(k) 

where  components  of  the  noise  vector,  ng(k),  are  independent  random  variables  with 


variance  a~  : 


E[nc(k)nr(k')l  =5er6kk»a~  . (11) 

(E  indicates  expectation.)  Equation  (1 1)  is  a somewhat  stronger  condition  than  in  many 
operational  noise  cancellers  (usually  ng(k)  = n(k  - C),  a white  noise  sequence),  but  is  typical 
of  most  theoretical  treatments.  As  indicated  in  Appendix  B,  it  could  be  circumvented,  but 
is  retained  for  the  sake  of  computational  simplicity.  As  a further  computational  conve- 
nience, we  assume  that  oc0  is  bin-centered;  i.e., 

6J0=-:p-  , s = integer.  (12) 

Throughout  our  development  we  shall  consider  x to  be  a deterministic  sinusoid  in 
white  noise;  i.e.,  9 is  fixed.  An  alternative  viewpoint  is  that  of  a narrowband  process  in 
white  noise  modeled  by  equation  (10)  with  9 a uniform  random  variable.  It  should  be  noted, 
however,  that  since  our  calculations  assume  0 fixed,  all  expectations  must  be  interpreted  as 
conditioned  on  9.  Nonetheless,  we  shall  find  that  the  final  results  are  independent  of  6. 
Consequently,  they  remain  valid  from  both  viewpoints. 

Finally,  we  make  the  assumption  that  the  primary  is  a stochastic  process  independent 
of  the  reference;  i.e.,  E(xd)  = E(x)  E(d)  where  the  expectation  E is  conditioned  on  9 in 
accordance  with  the  remarks  above.  It  is  also  assumed  that  the  correlation  function  of  the 
primary  is  stationary. 

From  equations  (4 ) and  (10) 

SCr=E(ACr) 

= 6gr  - 2p[C^  cos  (oe0(k  - 8)  + 6)  cos  (a>0(k  - r)  + 0)  + 5grJ 

r i 

= Sgr  - 2/i  I — cos  GJ0(C  - r)  + -y  cos  (0Jo(2k  - C - r)  + 29)  + 6grl 

= (I  - 2fiR)^r~  n C~  cos  (cu0(2k  - i -r)  + 29)  (13) 


where  ' 

Rgr=  cos  0>0(2  - r)  + a2  5gr  y'  (14 

is  the  classical  correlation  matrix  of  the  process  x.  A necessity  condition  for  stability 
of  the  ANC  is  that  the  magnitude  of  the  eigenvalues  of  1 -2fiR  be  less  than  one  ([5],  [6], 
Appendix  B).  In  Appendix  A,  it  is  shown  that  S = I - 2y&  has  two  eigenvalues  X and  L - 2 
eigenvalues  |3  given  by  / 


X=  1 -2n  (c2  j + a2j 


P = 1 - 2/ia  . 


OUTPUT  CORRELATION  FUNCTION 

Ultimately  we  are  interested  in  the  relationship  between  the  spectra  of  e and  d.  It 
would  thus  be  desirable  to  apply  transform  techniques.  However,  it  is  not  clear  from 
equation  (8)  that  the  correlation  function  of  e is  stationary,  let  alone  the  result  of  time 
invanant  operations  (which  in  general  it  is  not)  on  d.  We  therefore  proceed  carefully. 

Denote  the  correlation  function  of  e by 


&(k,k')  = E(e(k)e(k'))  . 


Define 


G,(k)  = d(k)  - 2/i  E[f(k,m)]  d(m) 


G2(k,k')  = 4/i2  >'  (E[f(k,m)  f(k  V)]  - E[f(k,m)  E[f(k>')] ) , (18) 

m=0  m =0  d(m)  d(m') 

where  f is  defined  in  equation  (9).  Since  f and  d are  independent,  it  follows  from  (8)  and 
(16) through (18) that 


k-1  kM 

E E 

r\  f—r\ 


S(k,k')=E[G1(k)G1(k')  + G2(k,k'))  . 


In  succeeding  calculations  we  shall  have  to  make  approximations  which  neglect  terms  of 
order  #i2  (denoted  0(/r2)).  This  does  not  mean  we  may  ignore  G2  since  the  summation  in 
equation  (18)  yields  a factor  (1  - X2)-*,  proportional  to  aT',  which  with  the  coefficient 
M2  is  of  order  At. 

It  follows  from  (11)  that  all  the  factors  of  (9)  are  independent;  thus, 


" - ' ’ : ' 


f 


! 


i 


HEP 


2^ 


E[f(k,m)|  = xT(k) 


(m)  , 


(20) 


where 


xg(k)  = C cos  (a>0(k  - 8)  + 0)  . 


(21) 


Furthermore,  it  is  shown  in  Appendix  B that  the  error  in  Gj  incurred  from  replacing  S(t) 
by  I - 2/uR  is  of  order  (a  consequence  of  the  oscillatory  behavior  with  respect  to  k of 
the  second  term  in  equation  (13)).  Also  equation  (A-l ) implies  that  x is  an  eigenvector  of 
1 - 2fjiR  with  eigenvalue  X.  Thus,  (20)  becomes,  approximately, 


E[f(k,m)]  =>(^(k)X*c  m * x(m). 

From  (21)  and  (12)  we  have 
L 

x^(k)  x(m ) = C“  £cos  (coQ(k  - 8)  + 0)  cos  (u>0(k  - m)  + 0) 


(22) 


C2L 


8=1 

cos  w0(£  - m) 


(23) 


We  also  note  that  since  0 < X < 1 , when  k is  large  the  sum  ^ ^ |Ef(k,m)|  is  arbitraily  small. 


Consequently,  the  lower  summation  limit  in  (1 7)  may  be  taken  to  be  (error  0 (m“)). 
Finally,  equations  (22)  and  (23)  imply  E[f(k,m)]  is  a function  of  k - m.  Thus,  we  may 
rewrite  ( 1 7)  as 


Gj  = (8  - 2/if+)*d  , 

where  * represents  convolution,  6 is  the  discrete  Dirac  delta  function,  and 

2\ 

9 


(24) 


Cft  x-»  ~ 


f+(s)  = 


COS  COqS 


0 


s>0 

s < 0 . 


(25) 


Now  let  r = k - k'  and 

D(r)  = E[d(k)d(k')l  . 

It  follows  from  (24)  that 

E[G,(k)  G,(k')]  = (h(s)*h(-s)*D)  (r) 

where 

h(s)  = 5(s)  - 2/d+(s)  . 


(26) 


(27) 


(28) 


J 


The  expectation  of  G2  i'  'alculated  in  Appendix  B (under  the  assumption 

OO 

ID(r)|  < «*).  Combining  that  result,  equation  (B-28),  with  (27)  and  (19),  we  have 
7=0  &(k,k')  = &(r) 

= (h(s)*h(-s)*D)  (r)  + 2p2  ct2C2L  q 6(r) 

2u2a2C2L 

+ — — - D(0)  A|r | cos  (tcj0) 

1 -X2 

+ 4 n2o4  /-2— + D(0)  5(r)  , 

\l-X2  l-(32) 

where 


OO  OO 

=£  £ Xs-  * Xs  1 cos  a>0(s  - s')  d(s  - s') 


s=l  s'=l 

2 2 

Note  that  the  last  three  terms  are  of  order  p since  p /(I  - X")  is  of  order  p.  It  is  also  clear 
from  (29)  that  the  correlation  function  of  e(k)  depends  only  on  k - k';  i.e.,  it  is  stationary. 
Thus,  its  discrete  Fourier  transform  is  proportional  to  the  average  of  an  ensemble  of  output 
power  spectra  (hereinafter  simply  referred  to  as  the  output  spectrum). 


OUTPUT  SPECTRUM 


The  spectrum  of  &(r)  is  given  by 
&(z)=  y]  8i(t)z~t 


where  z = elu;.  It  follows  from  the  convolution  theorem  for  z-transforms  that  the  transform 


rom  the 


of  h(s)*h(-s)*D  is  given  by  fhn  D.  Also,  from  (25),  we  see  that 


f(z.)  = y ] f+(s)  z-s 

S=-oo 

OO 

ELc2 

— Xs-1  cos  (OJ0S)  z" 


LC2  cos  co0z  - X 
2 z2  - 2Xz  cos  oj0  + X2 


Combining  this  with  (28)  and  5(z)  = 1 , we  have 
1i(z)=  I - 2pftz)  . 

It  is  not  difficult  to  show  that  h(z)  has  zeroes  at 
t ±iou,. 

zQ  = ( 1 - 2fia~)  e 0 + O(p-)  . 

Also,  in  view  of  (32),  the  transform  of  X|r|  cos  ou0t  may  be  written 


S x'sl 


COS  CJqS  z 


;~s  = 1 + — Re  t(z), 


where  Re  stands  for  real  part. 

Substituting  the  above  results  into  (29),  we  have 

A A i A 111 

Gi(z)  = !h(z)|-  D(z)  + 2 p-o“  C“L  q 


+ D(0)  ( 1 + ~ Re  f(z) 


4 yro4  / -i-  + ) D(0) 

\ 1 - A-  1 -0“  J 


It  is  clear  from  the  last  three  terms  of  (36),  whose  z dependence  is  independent  of  D(z), 

A 

that  the  relation  between  the  output  spectrum  3z  and  the  spectrum  D of  the  primary  input 
is  not  in  general  time  invariant.  Note,  however,  that  in  the  no-noise  case,  a~  = O.^these 
terms  vanish,  G-,  = 0,  and  the  relationship  reduces  to  (24)  with  transfer  function  h(z)  whose 
zeroes  then  lie  (“to  order  p~)  on  the  unit  circle.  This  agrees  with  the  results  of  Glover  in  [4] 
(2p  f(z)  equals  J(z)  to  order  p“). 

In  place  of  a transfer  function,  we  consider  the  ratio  of  the  output  and  input  power 

spectra 

A 

T(z)=-f^,  (37) 

D(z) 

which  for  o“  = 0 reduces  to  (fr(z)l*.  We  shall  examine  two  cases:  d(k)  white  noise  of  unit 
variance,  and  d(k)  a narrowband  signal  (e.g.,  sinusoid  with  random  phase)  centered  at  coQ 
and  of  unit  amplitude.  For  white  noise,  ft  = 1 , D(0)  = i , and  q = 1/(1  - X“),  thus 

T„oisc  - fiwi 2 ♦ + 7T5  ( : ' * rh  «*>) 

+ 4pV  /_!_  + . 08) 

\l-X-  1-0*/ 


■M 


The  autocorrelation  function  of  a sinusoid  is  given  by  D(r)  = cos  coqt.  This  function 
does  not  satisfy  equation  (B-l)  (also  (37)  become  meaningless);  however,  we  circumvent 
these  difficulties  by  assuming  a slight  amount  of  dampening  and  taking  a finite  transform. 

If  we  denote  the  transform  length  by  M,  6(e~ia>°)  = M and  D(0)  = 1 so  that  for  large  M,  the 

±icu 

fiTst  term  in  (36)  will  dominate  at  z = e °.  Thus,  although  for  general  u>  expression 
(36)  still  does  not  reduce  too  readily,  we  have  at  cjq 


lim  T 
M -*■  °° 


sine 


(e 


±icj„  a ±icu 
°)  = |h(e 


O)!2 


(39) 


III.  EXPERIMENTAL  RESULTS 

Both  a computer  simulation  and  experiments  with  a hardware-implemented  ANC 
were  performed  to  evalute  the  theory  of  the  previous  section.  The  parameters  for  the 
computer  simulation  were  - rr/2 , L = 16,  and  n = 0.01.  Two  hundred  twenty-two 

iterations  (i.e.,  k = 222)  were  followed  by  a 128-point  discrete  Fourier  transform  (DFT). 
The  input  reference  power  was  normalized  to  one  so  that  the  adaptive  time  constant 
([  1 ] , [5  ] , [61 ) was  about  50  iterations.  An  ensemble  of  200  output  power  spectra  were 
then  averaged.  The  primary  input,  d(k),  and  the  reference  noise,  ng(k),  consisted  of 
independent  pseudo-random  white  Gaussian  noise  sequences. 

A 

The  output  spectrum  £(  e'^)  for  a reference  signal-to-noise  ratio  (SNR  = C^/2 o~) 
of  0 dB  is  found  in  figure  2.  The  theoretical  spectrum  computed  from  equation  (38) 


Figure  2.  ANC  output  spectrum  for  white  noise  in  primary 
(D  = 1)  and  reference  SNR  of  0 dB.  The  filter  length  is  L=16, 
and  /u-.O I . The  solid  line  is  from  a computer  simulation;  the 
dotted  line  is  the  theoretical  spectrum  (eq.  (38)). 


A 

(T(z)  = &(z)  for  d white)  is  also  plotted  and  shows  exceptionally  good  agreement.  The 
same  simulation  was  repeated  by  replacing  the  Gaussian  noise  in  reference  with  noise 
having  a uniform  distribution.  The  differences  were  negligible.  Let  us  define  the  notch 
depth  (n.d)  as  the  ratio  of  the  output  spectrum  to  the  spectrum  of  the  primary  at  co0: 

n.d.  = T(e~  °)  . (40) 

A comparison  of  the  theoretical  and  simulation  notch  depths  for  a range  of  reference  SNRs 
is  given  in  Table  1 . 


Table  1 . Theoretical  and  simulation  notch  depths  for  a reference  SNR. 


Reference 

SNR 

(dB) 

6 

3 

0 

-3 

-6 

-9 

-12 

Theory 

0.072 

0.12 

0.20 

0.32 

0.47 

0.65 

0.82 

Simulation 

0.11 

0.13 

0.23 

0.34 

0.53 

0.73 

0.87 

The  theory  was  also  compared  with  the  results  of  experiments  performed  on  a 
hardware-implemented  ANC  with  analog  inputs  [7] . The  filter  length  was  L = 64,  the 
normalized  frequency  was  co0  = 0.69  radians  and  the  spectral  resolution  was  8 X 10“^ 
radians  (M  = 8192).  The  reference  power  varied,  producing  an  equivalent  range  of  /a  from 
0.00005  to  0.0001 . Details  may  be  found  in  [7] . The  reference  input  noise  vector  was  of 
the  form  ng(k)  = n(k  - C).  thus  violating  condition  (11).  Also,  all  inputs  were  low  pass 
filtered  at  0.6  Nyquist  (cc  = 1 .2n);  consequently,  the  reference  noise  spectrum  was  not  white. 

If  we  assume  the  approximations  in  Appendix  B remain  valid,  the  only  effects  of 
the  colored  reference  noise  spectrum  will  be  on  the  eigenvalues  of  R.  In  particular,  a low 
pass  fdter  with  bandwidth  BW  will  result  in  eigenvalues 


A = 1 - 2n 


P = 1 - 2n 


2BW 


(41) 


where  fs  is  the  sample  rate  ([5] , [7] ).  Also,  approximately  two  eigenvalues  are  A, 

2L  BW/fs  - 2 are  /3,  and  the  remainder  are  zero.  Note  that  this  calls  for  appropriate  changes 
in  the  last  term  of  (36). 

The  experiment  was  performed  for  two  primary  inputs:  sinusoidal  centered  at  o>0  and 
low  pass  noise.  For  the  noise  case,  the  accuracy  of  the  notch  depth  measurement  accuracy  was 
limited  to  about  2 dB  despite  extensive  time  averaging  on  a spectrum  analyzer.  The  results, 
notch  depth  versus  reference  SNR,  are  shown  along  with  the  theoretical  calculations  in 
figure  3.  Excellent  agreement  was  obtained  despite  the  fact  that  coQ  was  not  bin  centered, 
the  input  reference  noise  vectors  were  not  independent,  and  theoretical  approximations 
were  made  to  generalize  to  a low  pass  rather  than  white  reference  noise  spectrum. 


t 
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REFERENCE  SNR, dB 


Figure  3.  Comparison  of  notch  depths  for  theory  and  experiment.  The  symbol  A 
represents  experimental  results  for  a sinusoidal  primary  input,  and  0 for  a white 
noise  input.  The  dashed  lines  are  the  theoretical  curves. 


IV.  DISCUSSION 

It  is  enlightening  to  examine  our  results  in  the  context  of  classical  LMS  filter  theory; 
i.e.,  relate  them  to  the  Wiener  solution 

w*  = R_1  E(xd)  . (42) 

The  basic  hypothesis  of  the  Wiener  theory  - stationary  stochastic  inputs  - may  be  achieved 
in  the  present  case  by  letting  the  phase  6 of  equation  (10)  be  random  (Section  II). 

It  is  well  known  ([  1 ] , [2] , [41  through  [61 ) that  the  mean  of  the  ANC  weight 
vector,  E[wJ , coverages  to  w*  of  equation  (42).  For  a random  phase  sinusoid  in  the 
primary  correlated  with  the  reference  signal  (but  not  with  n(k)),  and  large  M,  the  power 
transfer  function  reduces  to  (39)  (approximately  0 for  go  ¥=  c oQ)  which  agrees  to  order  /a2 
with  the  Wiener  solution  ([  1 ] ).  However,  when  d is  independent  of  x,  w*  = R~*  E[xd]  = 0; 
that  is,  the  expectation  of  the  filter  is  0.  How  then  do  we  explai  the  presence  of  a notch 
filter  “transfer  function?” 

We  first  note  that  even  when  E(w)  = 0,  E(||w||2)  = Lyuf min,  the  so-called  misadjust- 
ment  noise  ([11).  Thus,  although  the  means  of  the  individual  weights  may  be  zero,  the 
magnitude  of  the  weight  vector  remains  finite.  To  confirm  these  remarks,  let  us  compute 


E(||w||2)  for  two  different  primary  inputs,  white  noise  and  sinusoid.  Applying  the  approxi- 
mations of  Appendix  B to  equation  (6),  we  have 


E(l|w||2)  = 4p2  ^ E(pT(m)  Rk"m_1  Rk_m'_1p(m'))  . (43) 


m=-oo  rn  =-°° 


For  d = white  noise,  E(p^(m)  p(m'))  = a L D(0)  8(m  - m')  where  a = C2/2  + a2;  while  for 


t r2i 


d = cos  (a>0k  + 0),  E(p  l(m)  p(m  ))  = 
from  (43)  that 


+ b5(m  - m')  where  b is  a constant.  It  follows 


E(llwll2)white=  = 0(M> 

E(llw||2)sine= -^4  = 0(1)  . 
(1-X)2 


(44) 

(45) 


The  magnitude  of  (45)  is  of  the  order  of  the  misadjustment  whereas  that  of  (46)  is  much 
larger;  i.e.,  that  of  the  Wiener  solution. 

Secondly,  we  note  that  no  matter  how  small  f(k,m)  (Z  f(k,m)  d(m)  = w • x,  the 

a m A 

filter  output)  f(z)  has  poles  near  the  unit  circle  which  give  rise  to  a notch  in  h(z).  As  the 
noise  in  the  reference  increases,  the  poles  move  away  from  the  unit  circle  decreasing  the 
notch  depth. 

In  summary,  we  have  derived  (and  confirmed  by  a simulation)  an  explicit  expression, 
equation  (36),  for  the  output  spectrum  of  the  adaptive  noise  canceller  when  the  reference 
input  consists  of  a sinusoid  (narrowband  signal)  plus  white  noise.  The  primary  input  was 
assumed  independent  of  the  reference  noise.  When  the  primary  contains  a component 
correlated  with  the  reference  sinusoid,  the  result  reduces  to  the  classical  Wiener  solution. 

On  the  other  hand,  when  the  primary  and  reference  are  independent,  the  means  of  the 
weights  are  zero.  Nevertheless,  the  narrowband  input  in  the  reference  gives  rise  to  a second 
order  solution  (E(||w||2)  ¥=  0),  the  weights  remain  highly  correlated  with  each  other,  and  a 
notch  appears  in  the  output  spectrum. 

For  a noise-free  reference,  the  relationship  between  the  output  and  primary  input  is 
approximately  time  invariant  (4) . In  general,  however,  a time  invariant  transfer  function 
does  not  exist,  and  the  output  spectrum  depends  explicitly  on  the  primary,  not  just  its 
power  spectrum.  This  is  reflected  in  figure  3 which  shows  a significant  difference  in  notch 
depth  between  a white  noise  primary  and  a sinusoidal  primary. 
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APPENDIX  A:  PROPERTIES  OF  R 


Let  Ggf  = — cos  t*)0(£  - r).  Then  xg(k)  = cos  (a>0(k  - 8)  + 0)  is  an  eigenvector  of  G. 


^G,,vk)-2^ 


cos  w0(2  - r)  cos  (co0(k  - r)  + 6) 


= cos  (t*>0(k  - 2)  + 0) 

LC^  ~ , 

= xfi(k)  , (A- 

L 

since  ojq  = implies  ^ cos  (u>0r  + <t>)  = 0. 

r=l 

It  is  easy  to  see  that  sin  (cjQ(k  - 2)  + 6)  is  an  eigenvector  of  G with  the  same  eigen- 

value.  Furthermore  Ggf  = — — (cos  wQ2  cos  w0r  - sin  cj02  sin  ou0r)  is  of  rank  < 2.  It 

“ ir2 

follows  that  G has  two  eigenvalues  equal  to and  the  remainder  zero  ([5] , 1 6 J ).  The 

4 

'J  -V/  -N* 

matrix  R equals  G + a~L  Let  S = I - 2/uR-  Then  S has  two  eigenvalues  X and  L - 2 of  0 
where 


X = 1 - 2*i 


(3=1-  2/iO^  . 

•N>  "V 

Also,  the  vector  x is  an  eigenvector  of  S with  eigenvalue  X,  and  the  trace  of  S is 
tr(Sk)  = 2Xk  + (L-2)/3k  . 
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APPENDIX  B:  APPROXIMATION  OF  E[G2(k,k')) 

The  central  idea  is  tc  approximate  G2  by  replacing  the  matrix  factors  Aft)  in  (18) 
by  their  expected  values.  Note  from  (9)  and  (18)  that  there  exist  pairs  of  factors  which  are 
correlated.  We  shall  assume  that  the  correlation  function  of  the  primary,  D(r),  is  absolutely 
integrable 


OO 


^ |D(t)|  = aQ  <°° 
t=0 

(B-l ) 

Let  us  write  ( 1 8)  as 

k-1 

k'-l 

E[G2(k,k')l  = ^ 

^ g(m,m') 

(B-2) 

m=0 

m=0 

f 9 


<♦. 

'I 


and  let  £ be  obtained  from  g by  replacing  A with  S = E(A).  For  small  n,  we  shall  demon- 
exis 

k-1 


strate  the  existence  of  nQ  such  that 


and 


k-1  k^l 

E S 

m=k-n0  m =k  -nQ 


k-n()-l  k'-n„-l 


|g(m,m')-g(m,m')|  <e( 


(B-3) 


o o o “ "o 

X 4*  <e2’  ZI  £ 


m=-oo  m =-oo 


k-nQ-l  k'-n„-l 


g(m,m') 


m=-oo  m =-oo 


<e2  , (B-4) 


where  terms  of  magnitude  ej  and  e-,  have  a negligible  effect  on  E(G->).  It  then  follows  that 
for  k,  k'  > n,. 


k k'  k k' 

X X X 2} 

n A I.  _ 


g(m,m') 


m=0  m 0 


m=k-n0  m =k  -n0 


t i 


g(m,m')  , 

m=-oo  m =-°° 
where  the  error  in  approximation  is  of  the  order  ej  + 2e2. 


(B-5) 
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SUBSTITUTION  OF  S = E(A)  FOR  A 


Replacing  A by  E(A)  in  the  second  term  of  g(equations  (B-2)  and  (18))  produces  no 
error  since  the  factors  comprising  f(k,m)  are  uncorrelated.  Thus  we  confine  our  attention 
to  the  first  term 

k-1  k'-l 

E[f(k,m)  f(k\m')J  =E[xT(k)  A(t)  x(m)  xT(k')  A(t')x(m')).  (B-6) 

t=m+l  t'=m  +1 

The  matrix  A(t)  is  correlated  with  A(t')  only  for  t and  t'  ranging  from  1 + max(m,m')  to 
min(k.k')  -1 . Denote  these  limites  by  tQ  and  t j , respectively.  The  corresponding  factors 
(possibly  the  empty  set)  give  rise  to  terms  containing  the  factor 

E[S  Arir2  (tQ)  A^^  (tQ  + 1) . . . A^  (tj)  Ar*  ^ (tQ) . . . A^tj)]  (B-7) 
rj’rj' 

which  is  independent  of  the  remainder  of  (B-6). 

Let  Q = A ® A be  the  tensor  product  of  A with  itself, 

O / r = A A > ' (B-8) 

^rlrV,r2r2  Aflr2  rlr2  • 

It  then  follows  from  (4),  (10),  and  (B-8)  that 

E(Q)  = S ® S + V , (B-9) 

where  V is  a non-negative  matrix  satisfying  II  V|1  < aj/i“  for  some  constant  aj  > 0 (provided 
the  fourth  moment  of  the  noise  is  bounded).  Let  T = S ® S and  Xy  indicate  the  maximum 
eigenvalue  of  T.  Then 

X j = 1 - 32*1  + 0(m2) 


Xy  < ajM 

Xq  = 1 -a3M  + 0(pL2), 

where  0 < aj  and  0 ^ a3  < a2-  We  shall  assume  that  n is  small  enough  so  that 
0 < XT,  Xy,  XQ  < 1 . Since  Qn  = (T  + V)n  - Tn,  we  have 


(B-10) 


IIQn-Tn||<2  (")  II  v II*  II  T lln_j 
j=  1 


< (XT  + Xy)n  - Xy 

<K)’- 


(B-ll) 


Secondly,  we  note  that  the  vectors  x are  correlated  with  A(t)  in  (B-6)  only  if  k # k' 
and/or  m # m'.  In  that  case  a typical  factor  is 

E(xs(k)  Aqr(t')>  = E(xs)  E(Aqr)  + a4M  + 0(/x2)  . (B-12) 

There  are  at  most  two  such  factors  in  (B-6). 

Let  nj  = k - m,  n2  = k'  - m',  and  n^  = tj  - tg  + 1.  We  first  replace  Q by  T in  (B-6) 
and  then  make  the  substitution  (B-12).  Assuming  the  first  two  moments  of  the  vector  x to 
be  bounded  and  taking  into  account  equations  (18),  (B-2),  (B-6),  and  (B-8)  through  (B-12), 
we  have 


k-1  kM 

£ £ 

m=k-nQ  m =k  -n0 


|g(m,m')  -g(m,m')| 


no_1  no_1 


£ L^nr2n3'^s^°) 

n]=0  n2=0  V 

• |D(n  j - n2  ± k - k')|  , 

where  a^  is  a constant,  X$  is  the  maximum  eigenvalue  of  S,  and 


1 . 


(B-13) 


(B-14) 


Note  that  Xs  < 1 , zn  is  an  increasing  function  of  n,  and  n2  < min  (n  j ,n2).  The 
above  sum  is  bounded  by  twice  the  sum  over  nj  > n->,  thus  if  we  let  r = nj  - n2,  inequality 
(B-13)  implies 


££  |g(m,m')  - g(m,m')| 


m m 


no  n’ 


</i2a5(Zno  + a4)2  £ £ X£|D(r  ± k - k') 


n | =0  t=0 


a5<znQ  + a4^  2 noao 


(B-l  5) 


where  we  have  used  (B-l ). 


1 

! 
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Similarly, 
k-n0-l  k'-nQ-l 

2 HZj 


m 


m 


< v*2  2 2 

nl=no  n2=no 

<^-*0*"Qo  ■ 


f4*) 


|D(nj  - n2  + k - k')| 


(B- 16) 


Since  Xq  > Xp,  the  same  approximation  holds  for^. 

It  is  straightforward  to  show  that  lim  ( 1 - a-wi)n  = 0 uniformly  in  m in  a neighbor- 

np  -*• 00  J 

hood  of  zero.  It  thus  follows  from  (B-10)  that  given  Cj  > 0 arbitrarily  small,  there  exists 
c->  such  that 


pn  >c2  = >Xj2>  <c,  « 1 (B-17) 

Relation  (B-17)  is  roughly  equivalent  to  the  statement  that  the  adaptive  time  constant  of  the 
ANC  is  inversely  proportional  to  p ( [ 1 ] , [51,  16]). 

Also,  it  follows  from  (B-10)  that  Xy/Xp  = a|P2  + O(p^).  If  we  set  b = pn, 


zb/p  = (1  + ajP"  + 0(p^))b^  - 1 


(B-18) 


Taking  logarithms  and  applying  L'  Hospital’s  rule,  we  find  that  lim^zj^  = 0 


= 0(p)).  Thus,  given  c3,  we  can  find  n'Q  dependent  only  on  b such  that  p 
bzb/p  < C3.  We  then  pick  pQ  < Pq  such  that 


(in  fact 
< p^  implies 


p<p0  = >(zb/p  + a4ii)b<2c3  • 


f B- 19) 


Now,  let  b = c2.  pick  pQ  such  that  (B-l  9)  holds,  and  given  any  p < pQ,  choose 
nQ  = b/p.  Then  (B-l  7)  also  holds.  The  inequalities  (B-l  5)  through  (B-17)  and  (B-l 9)  then 
imply  (B-3)  and  (B-4)  with 


e,  =*i4a0a5c3 

2 

e2=  rV  2wi  ci ■ c3 • <B-20) 

I - \q 

(Briefly,  cj  = > c2;  c2,  C3  = > PQ;  P,  c2  = > nQ;  Cj  and  c3  are  arbitrary,  aj  and  a^  depend 
on  x,  aQ  depends  on  D.) 
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APPROXIMATION  OF  S BY  S = I - 2//R 


It  remains  to  evaluate  g;(m,m'): 


g(m,m')  = 4/i2  (e  xT(k)  | | S(t)  x(m)xT(k')  j | S(t')  x(m') 


K-l  k - 1 \ 

-E  x^(k)  I | S(t)  x(m)  E x^(k')  j | S(t')  x(m')  jD(m  - m')  . (B-21) 


It  follows  from  equations  (12)  and  (13)  that 


to+L  \ /to+L  \ fo+L 

TT  S(t))  =(TT  (I’2#iR))  - 2 MC2cos(wo(2t-fi-r)  + 0)  + O(/i2) 

t-to  ' fir  't_tc  ' fir  t_to 

/ l°+L  \ 

= 1 (I  - 2/iR)  j +0(/i2)  . (B- 

V t=to  / fir 


Then, 


k-m  - 1 


S(t)  = ((I  - 2/aR)k-m  + O(n^)  L +a7#i. 


(B-23) 


where  the  constant,  a7,  arises  from  a product  of  at  most  L - 1 terms  (i.e. , accounts  for  the 
case  (k-l  - m)/L  not  integral)  and  is  independent  of  k and  m.  Expressions  (B-l  1 ) and 
(B-23)  imply  chat  the  error  incurred  in  replacing  S by  I - 2(jlR  in  the  above  product  is 
bounded  by 


( 1 + ag  /u~)n  - 1 + a7/i  ; n = (k-m-l)/L  . 


(B-24) 


Repeating  our  previous  arguments  (cf  (B-l  9)),  we  see  that  (B-21)  remains  valid  under  the 
additional  substitution  of  S = I - 2/iR  for  S. 

A similar  application  of  (B-24)  justifies  the  same  substitution  in  equation  (20). 
Note  that  in  that  case  although  the  coefficient  of  the  term  is  only  /i  (as  compared  with 
ju2  in  (B-l  5))  there  is  only  a single  summation  over  m.  Hence  the  factor  nQ  is  absent  and 
the  error  is  still  of  order  0(/i2).  These  same  techniques  could  be  used  to  relax  condition 
( 1 1 ) to  ng(k)  = n(k  - fi)  where  n is  white;  however,  we  refrain  from  doing  so  in  order  to 
avoid  complicating  what  are  already  fairly  unwieldy  calculations. 


r * 


»1 


<1 

Li 


COMPUTATION  OF  E(G2) 

Since  in  (B-2)  k > m and  k'  > m',  we  have  from  ( 1 0)  and  (2 1 ) 

E[xr(k)  xr>(k')  xg(m)  xg<(m')]  = xr(k)  xr'(k')  Xg(m)  xg»(m') 

+ a26(k  - k')  6(r  - r')  £g(m)  iTg'(m') 

+ o“5(m  - m')  5(8  - S')  x"r(k)  3Tr'(k') 

+ a-S(k'  - m)  5(r'  - 8)  xr(k)  xg'(m') 

+ a“6(k  - m')  6(r  - 8')  xr'(k')  xg(m) 

+ o45(k-k')5(r-r')5(m-m')6(8-e')  . (B-25) 

These  six  terms  appear  in  the  expansion  of  the  first  term  of  (B-2 1 ).  The  evaluation  of  (B-2 1 ) 
is  now  straightforward.  We  note  that  the  occurrence  of  the  first  term  of  (B-25)  in  ( B-2 1 ) 
cancels  the  entire  second  term  of  (B-2 1 ). 

For  illustration,  we  carry  through  the  substitution  of  the  second  term  of  (B-25)  into 
(B-2 1 ).  It  follows  from  Appendix  A that  x is  an  eigenvector  of  S with  eigenvalue  X. 
Replacing  S by  S in  (B-2 1 ) as  justified  above,  and  substituting  the  second  term  of  (B-25), 
we  have 


4p2^^  ^^a26(k  - k')  5(r  - r')  Xk  m_*  )Tr(m)  Xk  )Tr»(m')  D(m  - m') 


r=l  f=l 


cos  (ojQ(m'  -t)  + 6) 


L 

= 4p2a2C2  5(k  - k')  xk-m"l  xk  -m  D(m  - m')^  \os  (a>0(m  - r)  + 6) 

r=l 


= 4p2o2C2  6(k  - k')  Xk  m 1 ^k  -m  -1  cos  a>0(m  - m')  D(m  -m')  . (B-26) 

The  contribution  of  (B-26)  to  E[G21  may  be  calculated  by  summing  over  m and  m' 


y]  ^ 2p2o2C2L  5(k  - 

k')  Xk_m_^  Xk  _m  cos  cu0  (m  - m')  D(m  - m') 

m=-oo  m=-oo 

oo 

OO 

= 2 H2a2  C2L  6(k  - k') / ^ 

2^XsXs'cosoj0(s-s')D(s-s')  . (B-27) 

s=l 

s'=l 

20 


A reasonable  amount  of  similar  algebra  including  the  application  of  (A-2)  and 
(A-3)  yields 


E[G2(k,k')]  =F! +F2  + F3  + F4  , 


(B-28) 


where 


F j = 2 n2o2  C2  L q 6(k  - k') 

F2  = 2/a2o2  C2  L —(0l"  X,k-k'l  cos  con(k  - k') 


F,  = 4 /aV 


= 4„2„4  / 2_  x L-2 


1-XZ  1-0' 


D(0)  5(k  - k') 


F4  = 2fi2a2C2L  (qc  cos  u>0(k  - k')  - qs  sin  u>0  Ik  - k'l)  xlk_k  -1  • (1  - 6(k  - k')) 


q = y 1 Ex5"’  cos  wo  ~ s ) ^(s  - s')  D(s  - s') 
s=l  s'=l 


OO  OO 

= cos  uos  ®(s)  1 qs  = y \s~*  sin  ajQs  D(s) 


The  bracketed  expression  in  F3  containing  the  eigenvalues  X and  |3  of  S arises  from  summing 

the  trace  of  S ^ -znw  over  m.  F4  results  from  combining  the  effects  of  term  four  and 
five  of  (B-25). 

Since  X and  P are  of  the  form  1 - ni /x  + 0(/a2),  the  quantities  ju2/(l  - X2)  and 
M~/(  1 ~P 2)  are  of  the  order /a.  Making  use  of  (B-l),  we  can  also  show  that  q < aQ/(l  - X2) 
and  that  qc  and  qs  are  uniformly  bounded  in  /u.  Thus  Fj,  F->,  and  F3  are  of  orders, 
whereas  F4  is  of  order  /j2. 

2 

We  also  note  that  n /(I  - Xq)  in  (B-20)  is  of  order /a-  Since  cj  and  c?  may  be  taken 
arbitrarily  small  as  /a  goes  to  0,  we  have  lim  e 1 //a  = 0 and  lim  eJi a = 0,  This  implies 

H 0 /a  -+  0 “ 

that  e j and  e-,  are  negligible  compared  with  terms  of  order  /a  for  small  /a.  Thus,  our 
approximations  are  correct  to  order /a,  and  we  may  also  neglect  F4  in  equation  (B-28). 
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